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Abstraet 

The mission for Urban SEALS (Speeial Edueation Aeademie Leaders), a federally 
funded doetoral preparation program, is to prepare doctoral-level speeial edueators, 
ineluding those who are eulturally and/or linguistieally diverse (CLD) to assume 
leadership roles in the edueation of urban students with disabilities who are CLD. This 
report provides information on partieipant evaluations of the third year of implementation 
which involved comprehensive examinations and dissertation proposal preparation. 
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The primary aim of the Urban Speeial Education Academic Leadership (SEALS) 
program is to prepare doctoral-level special educators who are culturally and 
linguistically diverse (CLD) to assume leadership roles in the education of urban students 
with disabilities who are CLD (Barbetta, Cramer, & Nevin, 2004*). The doctoral students 
partieipate in a program of study whieh includes courses and non-credit leadership 
activities with the goal of developing the knowledge and skills needed to fiilfdl 
leadership roles that (a) prepare teaehers of CLD students with disabilities in urban 
settings, such as university professors and/or (b) support the education of students with 
disabilities in urban settings, particularly those who are culturally and linguistically 
diverse in roles such as special education program coordinators or directors. 

The SEALS program of study was designed on the basis of several 
reeommendations from the literature on retaining under-represented populations (e.g.. 
Smith, Pion, Tyler, & Gilmore, 2003; Smith-Davis, 2000, Talbert- Johnson & Tillman, 
1999; Wright, 1987). Specifically, the program faculty incorporated a cohort model, 
service learning and other leadership activities, a eurriculum and program of study that 
enfolded TESOL and/or Urban Education cognates, and fmaneial support for tuition and 
fellowships. Following the recommendations of the AAUP (2001), the faeulty had 
developed an inviting Exceptional Student Education (ESE) program with an urban 
special education leadership focus. The program of study for Urban SEALS candidates 
was built on an existing infrastructure in the ESE doetoral program and the COE 
resourees by enfolding principles articulated by Coehran-Smith (1999) to prepare urban 

' The annual survey of program participants’ experiences is a component of the Urban SEALS program 
evaluation plan which involves ongoing assessment during implementation of the project objectives. 
Process evaluation of program components occur regularly so as to monitor program implementation and 
modify program practices as indicated. 
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leadership personnel who teaeh for social justiee. Cochran- Smith (1999, p. 118-119) 
established six principles to be used when preparing urban teaehers to teach for social 
justice: enable signifieant work for all students within learning eommunities; build on 
what students bring to sehool with them: knowledge and interests, cultural and linguistic 
resources; teach skills, bridge gaps; work with (not against) individuals, families, and 
communities; diversify modes of assessment; make activism, power, and inequity explieit 
parts of the eurriculum. 

The Urban SEALS program embeds these prineiples within the processes used by 
faeulty and doctoral candidates as they eomplete their individually designed courses of 
study leading to the doetorate in edueation (Ed. D.). In addition, the delivery of the 
coursework by university urban education faculty, special education faculty, and research 
methodology faculty reflects researched best practices such as establishing collaborative 
learning communities through a cohort model. Other evideneed based praetiees that are 
refleeted in the program coursework include (a) ereating a focus on standards based- 
outcomes, (b) utilizing problem based learning, and (c) arranging experiential-service 
learning opportunities as well as non-credit-generating activities sueh as guest leeturing, 
teaching undergraduate or master’s level eoursework, attending eonferenees, 
collaborating with faculty on research projects. 

A descriptive study was eondueted to obtain the perceptions of the first eohort of 
doctoral students in the Urban Special Education Academic Leaders (SEALS) program 
upon eompletion of the third year of eoursework and experienees. During this third year 
of the eoursework, the faculty arranged for a eourse in which cohort members were 
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coached to write for the comprehensive exam and to prepare the first three ehapters of 
their dissertation researeh. 

Method 

Participants 

At the time of the study, 13 Urban SEALS doetoral students eompleted the 
survey: 10 female participants and 3 male partieipants. Table 1 displays the key 
demographie variables that deseribe their charaeteristies. 

Table 1. Demographics of Urban SEALS: Year 3 



Variable Category (N) 



Gender 


Male (3) 


Female (10) 




Ethnicity 


Blaek (3) 


Hispanie (6) 


White (3) Other (1) 


Age 


25-35 (7) 


36-45 (5) 


46-55 (1) 


Experienee 


0-5 (2) 


6-10 (6) 


11-20 (5) 



Ethnicity of the Urban SEALS ranged from those who identified themselves as 
Hispanie (N=6), Black (N=3), White (non-Hispanic) (N=3). One respondent ehose 
“other.” As shown in Table 1, the majority of respondents categorized their ages between 
25-35 (N=7) while 5 respondents eategorized themselves between 36-45 years of age and 
1 between 46-55 years. For years of teaehing experienee, two respondents indicated 
experiences in teaching for 0-5 years while 6 respondents indieated teaching for 6-10 
years; 5 indicated teaehing for 11-20 years. 
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Instrumentation 

The survey (see Appendix A) is derived from a questionnaire originally designed 
by the projeet eo-principal investigators to assess reeruitment and seleetion procedures 
(Nevin, Barbetta, & Cramer, 2006) whieh had been evaluated by the leadership advisory 
board (comprised of national and local experts in speeial education and urban education) 
and the FIU Human Subjects Review Board. The procedures were deemed to proteet the 
anonymity and eonfidentiality of respondents. The questionnaire was believed to meet the 
conditions required for faee validity onee minor format ehanges were made to the 
instrument (e.g., more space for responding to the open-ended questions). The following 
year, the eo-principal investigators modified the original instrument to allow respondents 
to evaluate their experienees and to voice their views about instruetional proeedures and 
faeulty interactions with them during the first year and first summer and reported at a 
national eonferenee (Barbetta, Cramer, Nevin, & Moores-Abdool, 2006). To evaluate the 
third year of coursework, the questionnaire was modified slightly to preserve the eontent 
of as many items as possible to mateh similar items ineluded in the previous surveys 
(2005, 2006, 2007) so as to allow eomparisons aeross the years of the projeet. This 
allowed the co-prineipal investigators to (a) use the survey information to make 
programmatic changes and (b) trace the impaet of programmatic changes based on the 
feedback from the partieipants in the program. In addition, one new item was added in 
response to a participant in the survey administered in Year 2 (2007) who had asked that 
the preparation for dissertation research be added as an item to evaluate in future surveys. 

The questionnaire was eomprised of four seetions. One seetion asked respondents 
to briefly deseribe their experiences in the third year by responding to open ended 
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questions such as “What barriers or ehallenges, if any, did you experience in the 
reeruitment proeess?’’ Another seetion colleeted demographie data (e.g., gender, 
ethnicity, age, years of teaching experience). Another seetion asked respondents to use a 
likert-style seale (with 1 = not at all to 5 = a great extent) to rate various statements about 
their perceptions of the proeedures utilized by faeulty, program co-prineiple investigators, 
program staff, and their eohort. The fourth section asked respondents to use a likert-style 
scale to evaluate various design features of the program. 

Data Collection and Analysis 

The instrument was distributed to all SEALS participants who had completed the 
third year of the program during a regularly seheduled meeting of the program 
partieipants. The eompleted surveys were colleeted by the projeet administrative 
assistant. For the few eandidates who were absent, they emailed their survey responses as 
an attachment to the program administrative assistant who removed any indentifying 
characteristics. 

Using the Statistieal Paekage for the Soeial Scienees (SPSS, 2004), the 
researchers caleulated ffequeneies and percentages for the demographie information and 
the ratings of program design features. 

Reliability 

Cronbach alpha eoefficients for reliability of respondents’ ratings were caleulated 
for survey items related to perceptions of fairness of the instructional procedures. 
Cronbach alpha, also called the alpha eoefficient, is a statistieal measure of the degree to 
which the items consistently measure the same construct. In this study, an alpha 
coefficient of .787 was obtained for items paired for internal consistency (Ql, Q4, and 
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Q5 within the Perception Seetion of the questionnaire), as shown in Table 2. In other 
words, the alpha eoefficient indieated good reliability for respondents eonsisteney in 
ratings for similar items. For example, Gall, Gall, and Borg (2003) report that alpha 
coeffieients of .52 and above are eonsidered evidenee of good reliability in exploratory 
research such as this study. 



Table 2. Reliability of Survey Items: Cronbach Alpha Coefficients 



Survey Item 


Alpha 

Coefficient 


To what extent do you believe the eourses you’ve taken at FIU during Fall 
2007, and Spring 2008 were taught by faculty who were fair and 
unbiased? 

I believe the teaehing strategies during the Fall 2007, and Spring 2008 
were fair and unbiased. 

I was treated respeetfully by faculty during the Fall 2007, and Spring 2008 
terms. 


.787 



Another indication of internal consistency is shown in Table 3. The means (4.6 out of a 5- 
point seale for all three items) and ranges of the ratings (3-5 for one item, and 4-5 for two 
items) indicate the elose agreement. 



Table 3. Range, Mean, and Verbatim Comments for Perceptions of Program Fairness 



Survey Item related to Perception Scale: l=Not at all to 5= A Great Extent 


Range 


Mean 


To what extent do you believe the courses you’ve taken at FIU during the Fall 
2007 and Spring 2008 terms were taught by faculty who were fair and 
unbiased? 


3-5 


4.6 


I believe the teaching strategies during the Fall 2007, and Spring 2008 were fair 
and unbiased. 


4-5 


4.6 


I was treated respectfully by faculty during the Fall 2007, and 
Summer 2009 terms. 


4-5 


4.6 
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Results 

Results are described in the following seetions: Perceptions, Design Features, and 
Responses to Open-Ended Questions 
Perceptions 

Table 4 shows the mean and range of the ratings for questions 1, 4, and 5 so as to 
provide a sense of the pereeptions of the 16 graduate students who responded to the 
survey. 



Table 4. Range and Mean of Ratings for Perceptions 



Survey Item 


Range 


Mean 


1 . To what extent do you believe the courses you’ve taken at FIU during the Fall 
2007 and Spring 2008 academic year were taught by faculty who were fair 
and unbiased? 


4-5 


4.6 


2. To what extent are you satisfied that your experiences during the Fall 2007 
and Spring 2008 academic year have been facilitated by project personnel 
(project co-Principal Investigators, Project Coordinator, or faculty)? 
Comment from 1 participant: RIO Comprehensive exam was biased! 


3-5 


4.4 


3. To what extent do you believe the coursework and experiences during the Fall 
2007 and Spring 2008 academic year were designed for culturally and 
linguistically diverse individuals to be successful? 

Comments from 1 participant: R5 Maybe during the fall, not the spring. 


2-5 


4.4 


4. To what extent do you believe that you were supported in preparing for your 
comprehensive exams? 

Comments from 2 participants: RS My cohort members helped a lot. 

RIO [The comprehensive exams] tested on information that was not covered in the 
courses. 


2-5 


3.6 


5. I believe the teaching strategies during the Fall 2007 and Spring 2008 
academic year were fair and unbiased. 


4-5 


4.6 


6. I was treated respectfully by faculty during the Fall 2007 and Spring 2008 
academic year terms. 

Comment from 1 participant: RIO [I] felt discriminated against. 


4-5 


4.6 


7. During the during the Fall 2007 and Spring 2008 academic year, I felt 
supported throughout the coursework. 

Comment from 1 participant: R5 The fall semester was totally different than the 
spring; I don 7 think they can be compared. 


2-5 


4.4 



As noted, the written eomments from 1 partieipant related to the items that rated faeulty 
treatment as fair and unbiased. For the eomprehensive exam, this participant felt that the 



exam was biased and that the participant felt “diseriminated against.” Further probing 
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would be necessary to identify the nature of the discrimination. In contrast, another 
partieipant added a comment about the value and support reeeived through the cohort. 
Ratings of Program Design Features 



Table 5 shows the mean and range of ratings for each program design feature. The 
majority of respondents did not offer any eomments on the program design features. 

Table 5. Range and Mean of Ratings for Program Design Features 



Survey Item 


Range 


Mean 


1 . diversity eontent and experiences 


3-5 


4.4 


2. cognate of courses directly related to the education of students 
who are CLD, (e.g., urban edueation and TESOL programs) 


2-5 


4.4 


3. community-based action research projects in the local urban, 
multicultural educational settings through the COE Center for 
Urban Education and Innovation 


2-5 


3.6 


4. field experiences with diverse students through service-learning 
projeets 


1-5 


3.6 


5. cohort model to promote and support group eohesiveness and 
motivate students to perform at an optimal level 


1-5 


3.1 


6. an existing learning eommunity of culturally and linguistically 
diverse individuals 


2-5 


3.9 


7. ongoing student involvement and development through 

partieipation in a variety of non-eredit leadership aetivities that 
require ongoing doetoral student development and involvement 
(e.g., presenting at conferences, teaching undergraduate eourses, 
partieipating in eommunity leadership projeets) 


1-5 


3.9 


8. Is there any other program design feature you’d like to evaluate? 
4 participants offered comments; 9 did not. 







The majority of participants did not offer to eomment or evaluate other program design 
features. Four participants added this eomment regarding other program design features: 
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R1 wrote, “Support was always available. ” R6 valued '‘Preparation of the dissertation 
proposal. R3 noted, “The program provided great support in preparing for 
comprehensive examinations, as well as guidance in writing a preliminary draft of the 
dissertation proposal. ” In eontrast, RIO pointed out that candidates should be “tested on 
area of interest for comprehensive exam only!!!” 

Responses to Open Ended Questions 

The responses to the open-ended questions corroborate and instantiate the survey 
ratings. In responding to the question {Overall, how would you describe your experiences 
during the third year of the doctoral program!), 13 of 15 SEALS eandidates completed 
the survey; all 13 of those who eompleted the survey commented on the overall impact of 
the third year. As shown in Appendix B, a total of 20 eomments were coded: 1 (5%) was 
coded Neutral; 5 (25%) were eoded as negative; and 14 (70%) were coded as positive. 
The most frequently mentioned challenge (N=5) was the overwhelming schedule and the 
writing demands that the eomprehensive exam and proposal process entails while 
juggling home and work responsibilities. Moreover, appreciation for the eohort was the 
most frequently mentioned feature of the program. Appreeiation for the projeet 
coordinators and selected faeulty was mentioned by 1 respondent. 

In the section of the survey which solicited comments about specific program 
procedures (see Appendix B), the responses to open-ended questions were equally 
revealing. All 13 participants offered 18 eomments related to supports for their success, 
in response to the question, What supports were in place to help you be successful in your 
doctoral program during the Fall 2007 and Spring 2008 terms? Of the 18 eomments, 
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100%were coded as positive. (See Appendix 2). Classes and seminars foeused on the 
dissertation, faculty and staff were most frequently mentioned as supports (9 out of 18 or 
50%), followed by the cohort model (6 out of 18 or 33%). Finaneial support in the form 
of stipends and books was mentioned in 2 out of 18 (1 1%) of the comments/ 

The majority of respondents (11 of 13) provided insights in response to the 
question: What barriers or challenges, if any, did you experience? (See Appendix B.) Of 
the 13 who eompleted the survey, 1 1 eommented on barriers, offering a total of 12 
comments. The majority reported the eomprehensive examinations as a barrier (N = 3); 
and time and work demands (N = 3). Other barriers that were named included being a 
part time student, lack of support and mentorship, writing, reimbursement for travel 
expenses, and personal issues. 

The majority of partieipants (11 out of 13) offered reeommendations in response 
to the question. Do you have any recommendations for modifying or improving the 
program? (See Appendix B.) Of the 1 1 reeommendations offered, 3 related to career 
goals (the professoriate or sehool administration) while 2 comments related to the 
comprehensive examination. The six remaining eomments ranged from (a) requests to 
help students fund their researeh,(b) use on-line instruction, (c) establish a faculty- 
candidate mentorship process, (d) supervise the instructors, (e) creating a produetive 
environment, and (f) using the grant as a motivating foree, in particular the termination of 
grant funding for tuition and stipends. 

Diseussion 

An important component of suceessful reeruitment of ethnieally and linguistieally 
diverse, traditionally underrepresented doctoral candidates is the subsequent retention of 
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candidates through their programs of study, through research and examination 
proeedures, and to graduation. The literature on retention of people from culturally and 
linguistically diverse populations as well as ethnically different populations indieates that 
peer groups and mentoring must be established early in the program. Cohort models 
appear to be successful depending on the extent to which cohort members support and 
mentor one another (Teitel, 1997). 

Several of the SEALS eandidates have become aetively involved with (a) adjunct 
professor opportunities at FIU and nearby colleges, (b) the University Upward Bound 
program, (e) the Center for Urban Edueation and Innovation which hosts a number of 
prominent eminent seholars, (d) the FIU Urban Studies faeulty. Some of the doetoral 
students have affdiated with institutional support at this level such as student 
organizations (the COE Graduate Student Network), aeademie and tutorial supports sueh 
a writing eenter, and a writing-for-publication elass for doctoral students (Marshall- 
Bradley, Tucker, & Wilson. 2006; Wright, 1987). The SEALS program of study also 
ineludes a one-eredit seminar whieh formally establishes proeesses that allow for the 
advanced graduate students to serve as mentors and buddies to the incoming cohort. In 
addition, scheduling cohort members into the same eourses is another method the faculty 
used to ereate affiliations that can sustain participants through the program, 

The results of the third year of eoursework as represented by ratings on program 
features and the open ended survey responses are similar to those found by Twale and 
Kochan (2000). They reported that the eohort experience was found to be personally and 
professionally rewarding and promoted friendships and idea exchanges. The eohort 
experience continued to help eandidates to meet existing ehallenges. 
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The goal of Urban SEALS is to prepare doetoral-level leaders in urban speeial 
education, particularly those who are culturally and linguistically diverse. Researeh has 
shown that new teaehers in urban schools leave at a higher rate than their suburban 
counterparts (Haberman & Rickards, 1990; Ingersoll, 2001). However, teaehers from 
culturally or linguistically diverse backgrounds are more likely to stay in urban sehools 
(Clewell & Villegas, 2001). Not only are culturally and linguistically diverse professors 
needed to join the professoriate (e.g., AAUP, 2001; Coehran-Smith, 1999) but CLD 
leaders are needed to prepare and support CLD teachers in urban schools. This in turn 
could have a positive impaet on the retention of CLD teachers in urban settings. 

It is elear that the eurrent eohort of doctoral students in the Urban SEALS 
program is culturally and linguistically diverse (ineluding Blaeks, Hispanics, and Whites 
non Hispanics). They have experieneed ehallenges in balancing their work and family 
responsibilities with the demands of an intensive doetoral preparation program (see Tyler, 
Smith, & Pion, 2003). Yet, due to the cohort model, they have established working 
relationships that have sustained and supported them throughout the rigorous coursework 
typieally assoeiated with the doctoral studies nationwide. This increases the probability 
that they will eontinue until graduation. 

In addition, the participants are actively engaged in thinking about their futures 
with respeet to doctoral research, notably the eomposition of their dissertation 
committees and the nature and preparation for the eomprehensive examinations. R noted, 
"'Both semesters prepared us for independent research. Both the class on urban research 
(participatory research) and independent research for our dissertations were very 
informative and allowed us to delve into personal areas of interest.^’’ They are also 
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actively involved in designing program improvements through enhaneing existing 
coursework and ereating meaningful alternatives that will allow for better program 
planning for future cohorts. For example, R1 wrote, ‘'I feel very prepared to become a 
professor based on the high quality instruction received.” In other words, they are 
already thinking in ways that they would need to think and plan when they leave with 
their doctorates in hand, when they join the administrative or professional development 
forces of the local public schools or when they join the teacher edueation faculty at 
colleges and universities. 
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APPENDIX A 

2008 Urban SEALS (Special Education Academic Leaders) Survey * 

We appreciate your help as we continue to evaluate the Urban SEALS program design and procedures 
utilized by project personnel. Your candid appraisal helps us to accurately assess and re-design our 
procedures. Your responses will be treated anonymously, and no personally-identifiable information will be 
reported. In this year’s evaluation, we would like to concentrate on your experiences during the Fall 2007 
and Spring 2008 academic year. 

Sincerely, P. Barhetta, E. Cramer, and A. Nevin, Co-Principal Investigators 



Overall, how would you describe your doctoral program experiences s during the Fall 2007 and 
Spring 2008 academic year? [Please write 2 to 3 sentences explaining your reactions.] 



Demographics 

Directions: Please fill in the blanks or check the items that apply to you. 




Gender: 
_ Male 


Ethnicity 


Age: 


_ Female 


_ American Indian or Native Alaskan 


18-24 




_ Asian or Pacific Islander 


25-35 


Experience teaching: 


_ Black (non-Hispanic) 


36-45 




_ Hispanic 


46-55 


_ 0 - 5 years 


_ White (non-Hispanic) 


56- 


6-10 years 
_ 11-20 years 
21 years + 


_ Other (specify) 





Program Procedures: Please write comments below: 

1 . What supports were in place to help you be successful in your doctoral program during the Fall 2007 
and Spring 2008 academic year? 

2. What barriers or challenges, if any, have you experienced during the during the Fall 2007 and Spring 
2008 academic year? (Please explain.) 

3. Do you have any recommendations for modifying or improving the program? 



* Note: This survey has been approved by FIU’s Institutional Review Board (Approval # 091806-00). 
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Perceptions 






Directions: Please use the following scale to rate your perception of each statement, where 1 = not at all 
and 5 = to a great extent N/A=not applicable to you 


8. To what extent do you believe the courses you’ve taken at FIU during the 

Fall 2007 and Spring 2008 academic year were taught by faculty who 
were fair and unbiased? 

COMMENTS: 


1 2 3 4 5 


NA 


9. To what extent are you satisfied that your experiences during the Fall 2007 
and Spring 2008 academic year have been facilitated by project personnel 
(project co-Principal Investigators, Project Coordinator, or faculty)? 

COMMENTS: 


1 2 3 4 5 


NA 


10. To what extent do you believe the coursework and experiences during the 
Fall 2007 and Spring 2008 academic year were designed for culturally 
and linguistically diverse individuals to be successful? 

COMMENTS: 


1 2 3 4 5 


NA 


11. To what extent do you believe that you were supported in preparing for 
your comprehensive exams? 

COMMENTS: 


1 2 3 4 5 


NA 


12. I believe the teaching strategies during the Fall 2007 and Spring 2008 
academic year were fair and unbiased. 

COMMENTS: 


1 2 3 4 5 


NA 


13. I was treated respectfully by faculty during the Fall 2007 and Spring 2008 
academic year terms. 

COMMENTS: 


1 2 3 4 5 


NA 


14. During the during the Fall 2007 and Spring 2008 academic year, I felt 
supported throughout the coursework. 

COMMENTS: 


1 2 3 4 5 


NA 
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Program Design 


Directions: Please indicate to what extent the features of the Urban SEALS doctoral program were 
reflected in the coursework and experiences you faced during the Fall 2007 and Spring 2008 academic 
year. Please use the following scale to rate each feature, where 1 = no influence and 5 = a great 
influence. 


1 . diversity content and experiences 


1 2 3 4 5 


2. cognate of courses directly related to the education of students who are CLD, 
(e.g., urban education and TESOL programs) 


1 2 3 4 5 


3. community-based action research projects in the local urban, multicultural 
educational settings facilitated through the COE Center for Urban Education and 
Innovation, research or presentation collaborative activities with faculty and/or 
other doctoral students, and so on. 


1 2 3 4 5 


4. field experiences with diverse students through service-learning projects or 
applied research projects supervised by faculty 


1 2 3 4 5 


5. cohort model to promote and support group cohesiveness and motivate 
students to perform at an optimal level 


1 2 3 4 5 


6. an existing learning community of culturally and linguistically diverse 
individuals 


1 2 3 4 5 


7. ongoing student involvement and development through participation in a 
variety of non-credit leadership activities that require ongoing doctoral student 
development and involvement (e.g., presenting at conferences, teaching 
undergraduate courses, participating in community leadership projects) 


1 2 3 4 5 


8. Is there any other program design feature you’d like to evaluate (e.g., 
comprehensive examinations, preparation of the dissertation proposal)? 





Thank you for completing this survey. 
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APPENDIX B 

Coding of Responses to Queries about Program Procedures 

What supports were in place to help you be successful in your doctoral program during the Fall 2007 and 
Spring 2008 academic year? 



Comments 


Coding 

Positive Negative Neutral 


R1 All instructors provided immediate corrective feedback and I felt 
my research interests were valued. 


+ 


R2 The cohort itself served as a support mechanism. 

Additionally, we were provided with the opportunity to meet other 


+ 


professors who assisted us in the dissertation course. 

R3 Course professors as well as professors from [other departments 


+ 


in] the College of Education in general were readily available when 
sought out for feedback on ideas and student work. 


+ 


R4 The only support available was being able to speak to certain 
faculty members about the direction of my coursework and possible 
future endeavors. 


+ 


R5 The continued support of the cohort experience [helped me to be 
successful.] 


+ 


R6 Seminars relating to specific areas of research, workshops, and 
independent text in dissertation process. 


+ 


R7 The cohort was amazing in assisting me and providing support. 


+ 


R8 My cohort has been very supportive. 


+ 


R9 [The availability of] SEALS staff for any concerns; 


+ 


support of the cohort. 
RIO Cohort members 


+ 


and family. 


+ 


R1 IThe constant supervision by Project Investigators and their staff. 


+ 


R12 Having classes that were extremely practical in nature helps out. 


+ 


One of the best classes I engaged in was during the spring term. I 
received valuable assistance and guidance in prepping for my 
comprehensive exams and the writing process. 


+ 


However, the best support available was the cohort model. As a 
group, we were able to help each other and bounce ideas back and 
forth. 


+ 


R13 Dissertation workshop, conference stipends, books for the spring 
course. 


+ 
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What barriers or challenges, if any, have you experienced during the during the Fall 2007 and Spring 
2008 academic year? (Please explain.) 



Comments 


Coding 


R1 I did not experience any barriers that I could honestly blame on the 
program or instructors. Opportunities were always available. 


No barriers 


R2 Comps were a challenge, but it served as a learning experience as 


Comps 


well. 


Work 


R3 Barriers were not due to the courses or professors; they merely 
came from our responsibilities at our work sites(the semester 
corresponded with heavy assessment timelines within our school 
district). This manifested itself in either missing some class sessions 
or limitation of time available to work on assignments. 




R4 It has been difficult to see your cohort advance to the 
comprehensive exam stage/dissertation and realize you still have 
coursework left to do. 


Personal 


R5 Just personal. 


Comps 


R6 The timelines affiliated with the comprehensive exam — it was 
originally scheduled for summer; however, the test occurred much 
earlier. 


Time demands 


R7 Time is always a factor in completing assignments or preparing 
adequately. 


Writing 


R8 Writing for dissertation has been a challenge. 


Time demands 


R9 Completing everything in a timely manner. 


Lack of support & mentorship 


RIO Lack of support and mentorship from staff. 


Reimbursement for travel 


Issue related to conference travel expenses (for example, paying in 
advance/reimbursement procedures) 


No barriers 


RllNONE 


Being a part time student 


R12 My biggest challenge was not having the full doctoral experience 
because I was a part time student. Since I work a full time job, I don’t 
have the opportunity to work closely with professors on research, 
learn how to publish well, or conduct research within the schools. 


Comps 


R13 The sit-down 9-hour comprehensive exam mentally wiped me 
out for a few weeks after the exam; too much pressure. 
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Do you have any recommendations for modifying or improving the program? 



Comments 


Coding 


R1 Yes, I think not everyone wants to be a professor or go into 
research. Perhaps two tracks should be offered in the future: 
research/professor and administration. 


Goals — ^professoriate or school 
administration 


R2N/A 




R3 These two semesters have been very productive. 


Productivity 


R4 Allow the students to choose a leadership component which will 
coincide with the educational leadership qualifications necessary for 
administration. 


Goals 


R5 Do not place the pressure of financial support ending as a way to 
push students forward. 


Motivating Candidates 


R6 Not at this time. 




R7 Allow those who want FL certification in leadership to take [those 
courses] in lieu of some other electives. 


Goals 


R8 More informal meetings to strengthen the cohort bond. 


More time for cohort meetings 


R9 Ensure that instructors chosen for course are teaching the specific 
content students are expected to master by end of program. 


Supervision of faculty involved in 
teaching the candidates 


RIO Early mentorship from staff which will allow for success in 
doctoral program; 


Establish a faculty mentorship 
process 


Follow University guidelines for comprehensive exams. 


University guidelines 


R1 1 Conducting more activities via on-line interactions. 


Use on-line instruction 


R12 Assist program students in finding outside funding so they can 
take a leave from work and not be affected financially. 


Funding student research 


R13 Consider the option of allowing students to choose their 
comprehensive exam format. 


Choice of comprehensive format 
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APPENDIX C 



Valences for the Coded Responses of the Partidpam 


ts’ Comments 


Comment 


Coding Valence 




+ - Neutral 


Overall, how would you describe your doctoral program experiences s during the Fall 
2007 and Spring 2008 academic year? [Please write 2 to 3 sentences explaining your 
reactions.] 

R1 I was extremely supported by all instructors and feel very prepared to become a professor 
based on the high quality instruction received. 


+ 


R2 The courses taken have been essential to moving [me] forward. We took a dissertation 
writing course that was extremely beneficial. 


+ 


R3 Both semesters prepared us for independent research. Both the class on urban research 
(participatory research) and independent research for our dissertations were very informative 
and allowed us to delve into personal areas of interest. 


+ 


R4 After a very full schedule during my first year, it was nice to have a more balanced work 
[time]. 


+ 


The courses were challenging. It is still difficult to work full time and take more than 6 credits at 
the doctoral level. 


- 


R5 The 2007-2008 academic year was a fairly challenging year. The preparation and experience 
of comprehensive exams were an experience I will never forget. 


+ 


I thank my cohort members for their support. 


+ 


R6 At this point, I feel overwhelmed with the amount of writing relative to my dissertation 
drafts. 


- 


However, I have felt supported by my instructors, courses and additional academic 


+ 


opportunities. 




R7 I feel elated to be “ABD”. 

The cohort was critical in getting me through the last of the coursework. 


+ 


R8 Very productive and informative. 


+ 

1 


R9 Probably the most significant in preparing me to be a professor at the college level as well 
as writing for publication. 


T 


RIO It was very challenging and overwhelming! 




R1 1 It went well. 




It did seem as if some of the classes should have focused more on how to conduct and write a 
dissertation. 




R12 My doctoral program experiences during the Fall 2007 and Spring 2008 academic year far 


+ 


exceeded what I imagined. 

All my efforts and hard work were finally coming to fruition and the support and 
encouragement I received during this time from my professors and colleagues was invaluable. 


+ 


R13 My doctoral program experience was intensive during spring 2008. 


N 


I felt too much pressure with the combination of comprehensive exams and the expectation of 
competing the 3 chapters of my dissertation. 


- 
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Purpose 



• Describe program need, goals, and features 

• Summarize 3''^ year program evaluation 

- participants’ perceptions and 

- ratings evaluations of program faculty and staff, 
comprehensive examinations, and dissertation proposal 
preparation 




Discuss implications and recommendations for urban 
)ecial education leadership preparation 
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Need for Project Urban SEALS (Special 
Education Academic Leaders) 



• Critical shortage of special education (SE) leaders, particularly 
those who are culturally and/or linguistically diverse (CLD). 

• Limited number of SE leaders with expertise in diverse students 
with disabilities. 

• Need for research in issues related to urban special education. 





Goal of Project Urban SEALS 



• Prepare doctoral-level special educators to assume 
leadership roles in the education of culturally linguistically 
diverse (CLD) urban students with disabilities. 
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Unique Program Features 

• Cognate of urban education courses related to education of 
students with disabiiities who are CLD. 

• Collaboration with Fill’s Center for Urban Education and 
innovation. 

• Guidance from National Urban SEALS Board 

• Engagement in urban-related, non-credit generating learning 
activities (e.g., conference presentations, university teaching.) 

• Use of urban special education scholars through personal 
presentations and teieconferencing. 





Urban SPED Competencies I 



• Recognize the unique strengths and needs of 
minority urban students w/ disabilities and the 
influential variables. 

• Understand and develop effective leadership skills to 
facilitate the education of urban students with 
disabilities. 

• identify and maximize the resources available in 
urban settings to facilitate the education of students 
with disabilities. 

• Understand the effects of community and culture on 
CLD urban students. 
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Urban SPED Competencies II 

□ 

• Develop vast knowledge and skills in Instructional 
approaches in the education of urban students with 
disabilities. 

• Conduct applied research that contributes to the 
knowledge base related to urban special education. 

• Establish alliances to provide effective special 
education through interagency, community and 
family collaboration. 

• Apply knowledge/skills through urban service- 
learning projects. 




SEALS Program Components 




Coursework w/ Urban Special 
Education Track 

Leadership Activities (Non-credit 
generating) 

Urban Special Education 
Teleconference 

COE Urban Center for Education 
and Innovation Student Associates 
Program 
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Professional Studies Core (6 hrs.) 



• EDP 7057: Educational Psychology: Advanced Applications 

• EDF 7937: Advanced Topics in Social Foundations of Education 





Special Education Core: (21 hrs.) 



• EEX 6535: Seminar in Special Education: Supervision and 
Leadership 

• EEX 7933: Advanced Topics in Special Education (3)(Topics 
vary, repeated) 

• EEX 7795: Advanced Issues In the Ed. of CLD Students with 
Exceptionalities 

• EEX 7977 Candidacy Research and Evaluation in Educational 
Psychology & SPED 

• EEX 7930: Professional Seminar in Special Education (repeated 
6 times, 1 credit seminar) 




Research Methods and Statistics: (12 hrs.) 

• EOF 6472: Research Methods in Education: introduction to 
Anaiysis 

• EOF 6486: Advanced Data Analysis in Quantitative Educationai 
Research 

• EDP 7058: Behavioral Intervention Research and Evaluation in 
Education 

• EDF 6475 Qualitative Foundations of Educational Research 





Urban Special Education Cognate (15 hrs.) 



• EDF 6689: Urban Education: Defining the Fieid 

• EDF 6942: Muiticuiturai Seminar and Practicum in 
Urban Education 

• EDF 6925: Special Topics in Urban Education (2 times) 

• ADE 6074: Writing for Publication 





Comprehensive Examination and 
Dissertation Study (24 hrs.) 

• EEX 7964 Comprehensive Examination 

• EEX 7980 Special Education Dissertation 




Non-credit Leadership Activity Areas w/ 
Examples 



Research and Evaluation 

• Conduct independent 
research* 

Professional Communication 

• Submit proposals for 
conference presentations 

Personnel Preparation 

• Independently teach one SE 
undergraduate course. 



Community 

Leadership/Advocacy 

• Provide leadership to a 
community agency project. 

Grantsmanship/Administration 

• Co-deveiopment of proposais 
of funded project 

Designing Interventions 

• Consult w/ families/agencies 




Urban SEALS National Board 





Function of Board 

• To help ensure meaningful connections w/ stakeholders. 

• Provide curricular and administration advise. 

• Support recruitment and placement efforts. 

• Participate in guest lectures and teleconference calls. 

Board Membership includes Grant Pis and 

• Local members (e.g., SPED & Urban Ed. Faculty from local universities 

• National members (e.g., Drs. Gwendolyn Cartledge, OSU; Cheryl Utley, 
Juniper Gardens, U of Kansas) 





Urban Special Education Teleconferences 



One to two times per year, a teleconference session or 
face-to-face with recognized experts in urban issues. 

Co-directors and Leadership Board members recommend 
experts in collaboration with SEALS. 

Prior to the session, doctoral students agree to read 
articles submitted by the “visiting” expert and pose 
questions. 







SEALS Cohort Building Activities 

• Moving students through coursework as a cohort as much as 
possible to promote support and continuity 

• Convening SEALS for a 1 credit seminar to bring all students 
together regularly (for 6 semesters) 

• Arranging group collaboration on projects and presentations 

• Sharing information and successes via Urban SEALS 
Newsletter 

• Organizing social gatherings (pot lucks and barbeques) 





Urban SEALS Recruitment 



Recruitment Facilitators 

• A SPED doctoral program with urban special 
education leadership focus, 

• Expanded recruitment efforts 

• Broadened admission process 

• Ensured financial and academic support 

• Option to attend full time or part-time 

• Cohort model 

Recruitment Activities 

• Emailing announcements to Universities 

• Announcements on local district e-mail list 

• Announcements through leadership board 
members 

• Urban SEALS website link via FlU website 






SEALS Recruitment Outcomes 



• During 2005-2006, recruited SEALS 16 students (14 females, 2 males): 
4 Black (25%), 3 White (19%), 9 Hispanic (56%) 

• During 2006-2007, recruited added 2 additional students, (1 female, 1 
male): 1 Black, 1 Hispanic 




SEALS Survey Administration: Years 1 & 2 



1®’ Year*--Administered October 2006 during a Graduate Class* 

* N = 14 SEALS students responded: 12 females, 2 males Ethnicity 
(Hlspanic=7, Black=3, White=3, Other=1). 

* Ages: 12 between 25-35 years old and 2 between 36-45. 

* Years of teaching experience: N = 5 for 0-5 years; N= 5 for 6-1 0 years; N= 4 
for 11-20 years; and 0 for 21 years or more. 

2 '^ Year**— Administered September 2007 during a Graduate Class [those 
absent or not enrolled In the class contacted separately] 

* N = 16 SEALS students responded: 12 females; 3 males; 1 No Response 

* Ethnicity (Hispanic=7, Black=4; White=3; Other=1 ; No Response=1) 

* Age: 1 1 between 25-35; 3 between 36-45; 1 between 46-55; 1 No Response 

* Years of teaching experience: N=1 (0-5 yrs); N=6 (6-10); N=5 (11-20); N=2 
(21 +); N=2 No Response 

*Barbetta, P., Cramer, E., Nevin, A., & Moores-Abdool, W. (2006, Nov.). Early lessons for planning and implementing a program to prepare urban special education 
academic leaders. Paper presented at refereed annual conference of Teacher Education Division, Council for Exceptional Children, San Diego, CA. ED494793. 

**Barbetta, P., Cramer, E., & Nevin, A. (2008, February). Impact of implementing strategies to increase retention of under-represented populations in a special education 
leadership doctoral program. Paper presented at annual conference of American Association of Colleges of Teacher Education, New Orleans, LA. ED500999 




SEALS Survey Administration 



• Year— Administered September 2008 during regularly 
scheduled meeting [those absent emaiied separately] 

• Demographics 



Variable 


Category (N) 






Gender 


Male (3) 


Female (10) 




Ethnicity 


Black (3) 


Hispanic (6) 


White (3) Other (1) 


Age 


25-35 (7) 


36-45 (5) 


46-55 (1) 


Experience 


0-5 (2) 


6-10 (6) 


11-20 (5) 




Year 3 Survey Results— Perceptions of Fairness' 



Range and Means for Perceptions of Program Fairness 



Survey Item (Rating Scale: 1=Not at all- 5= A Great Extent) 


Range 


Mean 


To what extent do you believe the courses you’ve taken at FlU 
during the Fail 2007 and Spring 2008 terms were taught by 
faculty who were fair and unbiased? 


3-5 


4.6 


I believe the teaching strategies during the Fail 2007 and Spring 
2008 terms were fair and unbiased. 


4-5 


4.6 


I was treated respectfully by faculty during the Fall 2007 and 
Spring 2008 terms. 


4-5 


4.6 



Cronbach alpha coefficient for internal consistency of responses = .78 , Gall, Gall, & Borg (2003) report that alpha coefficients of .52 and above 
•e considered evidence of good reliability in exploratory research such as this study. 




Year 3 Survey Results: Program Design Features 



Range and Mean of Ratings for Program Design Features 











^Survey Item (Rating scale: Likert Scale: 1 = not at all; 5 = a great deal) 


Range 


Mean 




diversity content and experiences 


3-5 


4.4 




cognate of courses directly related to the education of students who are CLD, 
(e.g., urban education and TESOL programs) 


2-5 


4.4 




community-based action research projects in the local urban, multicultural 
educational settings through the COE Center for Urban Education and 
Innovation 


2-5 


3.6 




field experiences with diverse students through service-learning projects 


1-5 


3.6 




cohort model to promote and support group cohesiveness and motivate 
students to perform at an optimal level 


1-5 


3.1 




an existing learning community of culturally and linguistically diverse 
individuals 


2-5 


3.9 




ongoing student involvement and development through participation in a 
variety of non-credit leadership activities 


1-5 


3.9 




any other program design feature you’d like to evaluate? 

4 participants offered comments; 9 did not. 











Year 3 Results-Participants’ Comments 

• The majority of participants did not offer to comment or 
evaluate other program design features. 



• Four participants added comments regarding other 
program design features: 

- R1 wrote, “Support was aiways available.” 

- R6 valued, “Preparation of the dissertation proposal. 

- R3 noted, “The program provided great support in preparing 
for comprehensive examinations, as well as guidance in 
writing a preliminary draft of the dissertation proposal.” 

- In contrast, R10 pointed out that candidates should be 
“tested on area of interest for comprehensive exam only!!!” 
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Year 3 Survey Results: Open Ended Responses 

■ 

Q: How would you describe your experiences? 

• Out of 1 3 respondents, all 1 3 wrote comments. 

• A total of 20 comments were coded: 

• 1 (5%) coded Neutral 

Example: R1 1 : It did seem as if some of the classes should have focused more on how to conduct and write 
a dissertation. 

• 5 (25%) coded Negative 

Example: R13: 1 felt too much pressure with the combination of comprehensive exams and the expectation of 
competing the 3 chapters of my dissertation. 

• 1 4 (70%) coded Positive 

Example: R3 Both semesters prepared us for independent research... allowed us to delve into 
personal areas of interest. 




Year 3 Survey Results 

Q: What barriers or challenges and supports, if any, 
■ did you experience? 

• Overwhelming schedule and the writing demands that the 
comprehensive exam and proposal process entails while juggling 
home and work responsibilities (N = 5) 

• comprehensive examinations (N = 3) 

• time and work demands (N = 3) 



•classes and seminars focused on the dissertation, faculty and (9 out 
of 1 8 comments, or 50%) 

•cohort model (6 out of 1 8 comments, or 33%). 

•financial support in the form of stipends and books (2 out of 1 8, 

11 %) 
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Year 3 Survey Results 

Q: Do you have any recommendations for modifying 
or improving the program? 

• 1 1 recommendations offered 

- 3 related to career goals (the professoriate or school 
administration) 

- 2 comments related to the comprehensive examination. 

- 6 remaining comments ranged from 

• (a) requests to help students fund their research, 

• (b) use on-line instruction, 

• (c) establish a faculty-candidate mentorship process, 

• (d) supervise the instructors, 

• (e) creating a productive environment, and 

• (f) using the grant as a motivating force, in particular the 
termination of grant funding for tuition and stipends. ^ 




Overall Conclusions 



• Open-ended questions corroborate and instantiate the survey 
ratings. 

• This means that the results seem to have validity and reliability. 

• We can trust that the doctoral students report their perceptions 
without fear of reprisal. 

• We can take action on the results with confidence. 




Urban SEALS Progress Report 

• By the end of the third year of the program, eleven 
students had completed their coursework. 

• They had successfully passed the written and oral 
comprehensive examinations and had achieved 
candidacy status. 

• Currently, the eleven candidates are in the process of 
completing the first three chapters of the dissertation 
and anticipated defending their proposals during the fall 
semester. 




Final Comments 



• R noted, “Both semesters prepared us for 
independent research. Both the class on 
urban research (participatory research) and 
independent research for our dissertations 
were very informative and allowed us to delve 
into personal areas of interest” 

• R1 wrote, “/ feel very prepared to become a 
professor based on the high quality 
instruction received.” 



Conclusion 



In other words, they have been thinking in ways 
that they would need to think and plan 

• when they leave with their doctorates in hand, 

• when they join the administrative or professional 
development forces of the local public schools or 

• when they join the teacher education faculty at 
colleges and universities. 
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